Operations management methods and devices thereof in information-processing systems

ABSTRACT

Total power consumption of information-processing devices and power supply/cooling facilities is reduced to realize energy saving operation of information-processing system. The information-processing system includes information-processing devices, power supply facilities, cooling facilities and an operations management device. The operations management device is connected to the devices and the facilities and includes layout information constituted of locations and operating information of the devices and locations and environmental information of the facilities. Also, the operations management device obtains the power consumption of the devices, the power supply loss of the power supply facilities and the cooling power of the cooling facilities by using the layout information, and then allocates the workloads to the devices so as to reduce the total sum of power consumption, supply loss and cooling power.

CROSS-REFERENCE TO RELATED APPLICATION

The present application claims priority from Japanese Patent ApplicationNo. JP 2008-100927 filed on Apr. 9, 2008, the content of which is herebyincorporated by reference into this application.

TECHNICAL FIELD OF THE INVENTION

The present invention relates to operations management methods anddevices thereof in information-processing systems constituted ofinformation-processing devices such as servers, storage units andnetworks and facilities for supplying power to or cooling the same. Moreparticularly, it relates to a technique preferable for synthetic energysaving operation management for the information-processing devices andthe facilities.

BACKGROUND OF THE INVENTION

According to Japanese Patent Application Laid-Open Publication No.2004-126968 (patent document 1), in a management server which executesjob scheduling for a parallel computer system, a new job is input to acomputer at low temperature based on temperature sensor information ofthe computer and the job is moved from a computer at high temperature toa computer at low temperature, thereby preventing the failures andperformance degradation of the parallel computer system due to hightemperature. Further, by estimating power consumption of each computerand a cooling unit provided at each computer based on the temperatureinformation before and after a job is moved, whether or not the job canbe moved is determined.

According to Japanese Patent Application Laid-Open Publication No.2007-179437 (patent document 2), in a management system for a pluralityof computers, an overheating computer and a non-overheating computer areextracted based on the temperature distribution and operatinginformation of the computers and software is moved from the former tothe latter, thereby achieving energy saving. Also, after extracting atarget computer, changes in computer electric power and air conditioningelectric power before and after the software is moved are compared,thereby determining whether or not the software can be moved. Thecomputer electric power is obtained from the operating information, airconditioning electric power is obtained from the temperaturedistribution and the temperature distribution is obtained from thetemperature sensor, the temperature history and the operatinginformation.

According to US patent application publication No. 2006/0259621 (patentdocument 3), in a method for allocating workloads to a plurality ofservers in a data center, the profile of a requested workload iscompared with a history profile and the requested workloads areallocated to servers in accordance with the history in which electricpower of the server and air conditioner is at the lowest level. If thereis no matching history, the workloads are allocated at random. Thehistory profile includes server location, class, operating information,intake temperature, exhaust temperature, workload type and electricpower of the server and air conditioner. The electric power of theserver and air conditioner is obtained from the intake/exhausttemperatures of the server, specific heat and amount of air or measuredwith a power meter.

According to US patent application publication No. 2006/0259793 (patentdocument 4), in a method for distributing electric power to a pluralityof servers in a data center, electric power budget is lent or borrowedbetween servers or racks neighboring in their geographic locations so asto approach an ideal analog temperature distribution or electric powerdistribution, and a discretized electric power state of the servers isspecified based on the budget allocation, thereby preventing serverfailures due to a hot spot or cold spot. A thermal multiplier whichindicates an ideal electric power to each server is obtained from theexhaust temperature of each server, the reference exhaust temperature ofaverage servers and the intake temperature of the air conditioners.

SUMMARY OF THE INVENTION

With rapid progress of information communication in recent years andtoward the integration era of broadcasting and communication,information-processing devices are expected to increase explosively. Onthe other hand, in order to reduce carbon dioxide for the prevention ofthe global warming, a large-scale reduction of power consumption of theinformation-processing devices has been demanded. Particularly in a datacenter which bears the information processing foundation at a back end,in addition to the electric power consumed by the information-processingdevices, the electric power consumed by the facilities for supplyingpower or cooling accounts for a large proportion of the electric powerconsumed in the data center, and the synthetic reduction of the electricpower of the devices and facilities has been an important issue.

For the energy saving of the data center, various measures have beentaken for information-processing devices such as servers, storages,networks, power supply facilities, cooling facilities and systemoperations management. In the information-processing device, itsperformance per power consumption has been improved by the use of lowpower devices and circuits, and the adoption of the energy savingfunction by switching of operation/idle states in accordance with aworkload has been accelerated. In the power supply facilities, reductionof power supply loss in the power supply system from an electrictransformer, uninterruptible power supply system, power distributionpanel and distributor to the power supplies of the devices andimprovement of transformation efficiency have been carried out. In thecooling facilities, improvement of the operating efficiency of the airconditioner itself, optimization of air flow design at intake/dischargeports and introduction of localized cooling and liquid cooling havestarted recently. In the operations management, operations informationmonitoring, job scheduling and operations efficiency improvement andconsolidation of the devices by virtualization have been mentioned asmain measures.

Although the power supply facilities and cooling facilities are designedbased on the maximum rated power of the devices in general, theefficiency and electric power of the facilities at the time of operationdepend largely on the distribution and changes of electric power of thedevices with respect to the facilities. For example, since the powertransformation efficiency depends on power load, the power supply lossdiffers depending on the operating power of the device and the powersupply system. Further, since the efficiency of the air conditionerdepends on the electric power or heat generation of the device, thepositional relation or distance between the air conditioner and thedevice, temperature, air amount and air direction, the cooling power islargely affected by the electric power and arrangement of the devices.

In the near future, it is expected that the operations management byvirtualization of the data center will be progressed and theconsolidation or live migration is utilized for energy saving.Therefore, measures for reducing the total electric power of the devicesand facilities by sufficiently taking into consideration the unevennessand change with time of the power distribution of devices with respectto facilities will be required. Although some examples have been knownas the operations management method for the temperature and electricpower in devices such as servers and computers, the cooling facilitiesand the air conditioners in the prior art, they are still localized orsequentially-taken measures in the light of the above-describedsynthetic energy saving.

In such a circumstance, although the rise of temperature in the computeris suppressed by allocating a job to a computer having a low temperatureof parallel computers in the patent document 1, the computer having alow temperature does not always lead to energy saving in the case wherediversified information-processing devices are mixed like in the datacenter. Further, since the power consumption of the computers isestimated before and after the job is moved, the electric powers aredropped in the computer from which the job is moved and the computer towhich it is moved. However, this is only a local energy saving operationin the light of the entire parallel computers. Although the estimationof the power consumption includes the electric power of the coolingfacilities attached to each computer, since no consideration is given tothe arrangement of the air conditioners and computers, even if theelectric powers are dropped in the computers and cooling facilities, theair conditioning power may be raised to increase the total electricpower of both the computer and air conditioner depending on theallocation of the job.

In the patent document 2, software is moved and dispersed from anoverheating computer to a non-overheating computer. However, thecomputer having a low temperature does not always consume a low power,and further, more energy saving can be sometimes attained in the entirecomputers by concentrating software on a particular computer whilekeeping other computers idled or stopped. Also, although changes incomputer power and air conditioning power are compared between beforeand after the software is moved, the objects for the comparison arelimited to the extracted overheating and non-overheating computers, andthe total powers of the computers and the air conditioners are not takeninto account.

In the patent document 3, a requested workload is allocated to theserver based on a history profile in which the electric powers of theserver and the air conditioner are the lowest. Consequently, the totalpowers of the servers and air conditioners can be reduced for a newrequest within the history, but this cannot cope with a case where thereis no adaptable history or an allocated workload is changed largely, orjust the sequential improvement in accordance with the accumulation ofthe history is achieved. Further, although the location of the server isincluded in the history profile, the air conditioning power is obtainedfrom the server intake/exhaust temperature or power meter and thepositional relation between the server and the air conditioner is notconsidered. Thus, allocating the workload to a server at a locationwithin the range appearing in the history does not always minimize thetotal powers of the servers and air conditioners.

In the patent document 4, the power budget is lent and borrowed betweenservers in the neighborhood so as to approach an ideal temperaturedistribution, and thus, the total power of the entire servers is notreduced. Further, since power is distributed to the serversmacroscopically in order to average the temperature, this conflicts withthe energy saving by the consolidation of servers. Although thegeographic location of the servers, the exhaust temperature and theintake temperature of the air conditioner are referred to distribute theelectric power, the electric power and arrangement of the airconditioners are not considered, and thus it does not contribute to thereduction of air conditioning power. The power states specified in theserver are a standby mode (standby power) and a maximum operation mode(maximum power) and changes in power in accordance with the workload isnot considered, and the energy saving function of the server itself isnot used effectively.

As described above, the prior art has such a problem that the powers ofthe information-processing devices and the air conditioners are reducedjust locally or sequentially. Accordingly, an object of the presentinvention is to reduce the total power of the devices and facilities bycomprehensively considering the power distribution and changes of thedevices and the arrangement with respect to the facilities, therebyachieving the energy saving operation of the information-processingsystem typified by the data center. Conceptually speaking, for theenergy saving of the devices only, the workloads should be concentratedon a certain device while other devices are idled or stopped, and forthe energy saving of the facilities only, the power of the devices isdispersed as much as possible in the arrangement capable of achievinghigh operation efficiency. Therefore, the present invention provides anoperations management method and an operations management device forallocating workloads to devices in an appropriately consolidated anddispersed manner so as to satisfy the contradicting requests of thedevices and facilities, thereby achieving the optimization to minimizethe total power of the devices and facilities. The above and otherobjects and novel characteristics of the present invention will beapparent from the description of this specification and the accompanyingdrawings.

The feature of the typical embodiment of the present invention lies inthat means having layout information including the locations andoperating information of information-processing devices and thelocations and environmental information of facilities and obtainingpower consumption of the devices with respect to the workload based onthe operating information; and means for obtaining the power supply lossor cooling power of the facilities with respect to the power consumptionof the devices based on the layout information are provided, wherein theworkloads are allocated to minimize the total power of the devices andfacilities.

The locations and operating information of the devices are collected soas to grasp the location and workload of each device of the entiredevices instead of extracting the overheating/non-overheating devices asmentioned in the patent document 2. The operating information issufficient information for calculating power consumption when a workloadis moved from one device to another device, and the specification andconfiguration of the device are included according to need. Thelocations and environmental information of the facilities are collectedso as to grasp the power supply loss of a power supply system from anelectric transformer to a device power supply in the case of the powersupply facility, and to grasp a heat exchange cycle from the externalair to the device or a heat source via the air and refrigerant and acooling power in the case of the cooling facility. The environmentalinformation is collected also from a built-in sensor or an externalsensor of the facility and from the operating information of the devicesif necessary.

In the means for obtaining the power of the devices, the power changingin accordance with the amount of the workloads in the entire devices isobtained from the operating information instead of from the temperatureinformation in the patent document 1, the history in the patent document3, and the fixed power in maximum operating/standby states in the patentdocument 4 and without limiting the objective devices tooverheating/non-overheating devices as in the patent document 2. In themeans for obtaining the power of the facilities, the power of the entirefacilities in accordance with the power distribution and changes of thedevices is obtained from the layout information of the devices andfacilities instead of from the temperature distribution in the patentdocument 2, the history in the patent document 3, and the power of acooling device included in each device in the patent document 1. In themeans for allocating the workloads to devices, the workloads areallocated based on an optimum solution obtained with respect to theentire devices without limiting the objective devices to the deviceshaving a low temperature as in the patent document 1, non-overheatingdevices as in the patent document 2, devices left in the history as inthe patent document 3, and devices neighboring in the geographiclocation as in the patent document 4.

Another feature of the typical embodiment of the present invention liesin that means for monitoring the layout information including thelocations and operating information of the devices and the locations andenvironmental information of the facilities and allocating virtualworkloads to devices based on a current or scheduled workload; means forobtaining a virtual power consumption to the virtual workload of thedevices based on operating information; and means for obtaining virtualpower supply loss or virtual cooling power of the facilities based onthe layout information and virtual power consumption are provided,wherein an optimum solution of the virtual workload allocation whichminimizes the total sum of the virtual power consumption of the devicesand the virtual power supply loss or virtual cooling power of thefacilities is obtained.

A number of combinations exist in the allocations of the workloads tothe devices, but by searching for the solution which minimizes the totalpower of the devices and facilities by allocating virtual workloads, anoptimum solution is found out efficiently and real workloads areallocated to the devices based thereon. The allocation of virtualworkloads can be carried out to not only current workloads but alsoscheduled or estimated workloads. In searching for a solution,constraint conditions such as an operating temperature condition oradmissibility workload condition of the devices, an admissibility powercondition of a power distribution panel and a rack power supply of thepower supply facilities, a cooling capacity of the cooling facilities,and an area admissibility power condition for avoiding heat pool ofcooling facilities can be taken into consideration.

Still another feature of the present invention lies in that layoutinformation in which the location coordinates and operating informationof the devices, the location coordinates of the facilities, and theenvironmental information regarding power supplying and cooling in aspace where the devices and facilities are installed are mapped isprovided. The operating conditions and layout of the devices andfacilities in a real space are reproduced in a virtual space, wherebyallocation of workloads to the devices and operation simulation of thefacilities are carried out integrally in a common virtual space andoperations management in which the devices and facilities are closelylinked with each other is executed. Further, by visualizing the virtualspace, the operation monitoring of the devices and facilities, businessoperation, failure detection, resource management and power control canbe carried out collectively and efficiently.

Still another feature of the present invention lies in that a devicepower function for calculating power consumption to the workload of adevice based on the specification of the device, configuration,measuring information, operating information or operating history isprovided, wherein the power of the device in accordance with theallocation, change and moving of workloads can be easily obtained. Forexample, the device power function p_(Di) (i=1, 2, . . . ) of the devicei can be expressed as shown in the expression 1 where a set of variablesindicating a workload j (j=1, 2, . . . ) is l_(jk) (k=1, 2, . . . ).p _(Di) =p _(Di)(l _(j1) ,l _(j2), . . . )=p _(Di)(l _(j))  [Expression1]

When the allocation of workloads to the devices is changed, the sets ofvariables are replaced between devices, and when workloads are allocatedto the same device in duplicate, arithmetic operation is carried outbetween the sets of variables to obtain a power corresponding to theduplicated workload. If a workload exists (device is operated), thedevice power function p_(Di) is set to a multivariate linear function ornonlinear function, and if no workload exists (device is idled orstopped), it is set to a discontinuous function which gives a powervalue. The device power function p_(Di) may be a return value orinterpolation of a numerical table to a variable.

As the device power function p_(Di), any factor may be adoptedappropriately in accordance with obtained information and requiredcalculation accuracy. For example, a step function corresponding toON/OFF of a device is adopted if a maximum rated power is known from thespecification and configuration of the device, a linear functionexpressed with a slope and intercept is adopted if the maximum power andstandby power is known, a conditional function set is adopted if pluraloperating states, standby state, idle state or stop state are known asoperating information, and a quadratic function to which operatinghistory data is fitted is adopted if the power consumption of a devicecan be monitored. For simplification, the set of variables l_(j) may beconsolidated to main factors which affect power. For example, the mainfactor is maximum performance, utilization or an operating state(frequency, voltage) of a processor for the server unit, the number ofactivated disks, access pattern or access time for the storage unit, andtransfer throughput or switching frequency for the network unit.

Still another feature of the present invention lies in that a facilitiespower function for calculating the power supply loss or cooling power ofa facility with respect to the power consumption and locations of thedevices and the environmental information and locations of thefacilities is provided, thereby easily obtaining the power of facilityin accordance with the power distribution of the devices by theallocation of workloads. For example, the power supply loss functionp_(s) and the cooling power function p_(c) can be expressed as shown inthe following expressions 2 and 3 where the power of a device i isp_(Di), the location thereof is x_(i)(x_(i), y_(i), z_(i)), theenvironmental information of a facility ι(ι=1, 2, . . . ) is ε_(ι), thelocation thereof is χ_(ι)(x_(ι), y_(ι), z_(ι)).p _(s) =p _(s)((p _(D1) ,x ₁),(p _(D2) ,x ₂), . . . ,(ε₁,χ₁),(ε₂,χ₂), .. . )  [Expression 2]p _(C) =p _(C)((p _(D1) ,x ₁),(p _(D2) ,x ₂), . . . ,(ε₁,χ₁),(ε₂,χ₂), .. . )  [Expression 3]

The power supply loss function p_(s) obtains a power supply system froman electric transformer, uninterruptible power supply, powerdistribution panel and distributor to a device power supply based on thelocation of the device and the environmental information and thelocation of a power supply facility, and calculates a power supplyefficiency and power supply loss to device power or power load along thepower supply system, thereby calculating the power supply loss of theentire power supply facilities. The cooling power function p_(c) carriesout thermo-fluid simulation of the room where devices are installed andheat exchange simulation of cooling system from an indoor cooling unitto external machines such as a chiller and cooling tower based on thelocations and power (heat source distribution) of devices and theenvironmental information and locations of cooling facilities, therebycalculating the cooling power of the entire cooling facilities.

As a location x_(i) of a device, an expression capable of identifyingits three-dimensional location, such as the two-dimensional location ofthe rack in which the device is mounted and the number in a rack heightdirection or the two-dimensional location of a floor tile on which thedevice is placed and the height thereof from the tile, can be used inaddition to its three-dimensional location coordinates. As theenvironmental information ε_(ι) of the power supply facility, the powerload characteristic of a power supply, distributor or wiring and I/Opower monitored by each machine or rack can be used. As theenvironmental information ε_(ι) of the cooling facility, the temperatureand humidity of the air and refrigerant, flow amount, flow rate, flowdirection, operating temperature of a device, intake/exhaust temperatureof a rack and a intake/exhaust port, intake/exhaust temperature or flowamount of indoor machine or outdoor machine, temperature and humidity ofthe external air, thermal load characteristic of each machine or thelike can be used. As the location information χ_(ι) of a facility,topological connecting information such as the connecting destinationand mutual distance of respective machines can be used in addition toits three-dimensional location.

Still another feature of the present invention lies in that acombinational optimization problem of allocating workloads to devices isdefined with using the total sum of the device power function andfacilities power function as an objective function, thereby obtaining anoptimum solution which minimizes the objective function or an executableapproximation solution near the optimum solution. For example, anobjective function P which indicates the total power of the devices andfacilities can be expressed as shown in expression 4 by using the devicepower function p_(Di) of the expression 1 and the facilities powerfunctions p_(s) and p_(c) of the expressions 2 and 3.

$\begin{matrix}{P = {{{\sum\limits_{i}p_{Di}} + p_{S} + p_{C}} = {{\sum\limits_{i}{p_{Di}\left( l_{j} \right)}} + {p_{S}\left( {p_{Di}\left( l_{j} \right)} \right)} + {p_{C}\left( {p_{Di}\left( l_{j} \right)} \right)}}}} & \left\lbrack {{Expression}\mspace{14mu} 4} \right\rbrack\end{matrix}$

The device power p_(Di) is a function p_(Di)(l_(j)) which depends on theallocation of a workload j to the device i, and the facility powersp_(s) and p_(c) depending on the device power p_(Di) can be expressed asfunctions p_(s)(p_(Di)(l_(j)) and p_(c)(p_(Di)(l_(j))) with usingp_(Di)(l_(j)) (i,j=1, 2, . . . ) as a variable (p_(s) and p_(c) areexpressed simply although they are the functions of the location x_(i)of the device, the environmental information ε_(ι) of the facility and alocation χ_(ι)). Accordingly, since the objective function P depends onthe allocation of the workload j to the device i, the reduction of thetotal power of the devices and facilities can be converted to theoptimization problem of searching for the solution minimizing theobjective function P from the combinations of workload allocations. Thenumber of combinations N in allocating m workloads to n devices whilepermitting duplications can be expressed as shown in expression 5.

$\begin{matrix}{N = {{{}_{}^{}{}_{}^{}} = {{{}_{n + m - 1}^{}{}_{}^{}} = \frac{\left( {n + m - 1} \right)!}{{m!}{\left( {n - 1} \right)!}}}}} & \left\lbrack {{Expression}\mspace{14mu} 5} \right\rbrack\end{matrix}$

Upon solving this combinational optimization problem, if n and m aresmall or the time interval of the workload allocation is long enough, anoptimum solution can be obtained by searching all the solution spaces.In other cases, however, an approximation solution method of efficientlysearching for a solution is used. As the approximation solution method,as well as generally known meta-heuristic algorithms such as localsearch, hill-climbing search, annealing search and taboo search, analgorithm which utilizes the performance/power index of the devices andthe characteristics of the facilities and is specialized in this problemcan be adopted.

Still another feature of the present invention lies in that thefacilities power function with respect to the power and location of thedevices and the environmental information and location of the facilitiesis approximately disassembled into element functions expressing afacility power required for each device, thereby solving thecombinational optimization problem in a simple manner. Since the sum ofthe device power function and the facilities element function is definedfor each device as a device function, the value of the objectivefunction for the workload allocation can be calculated in a short time.For example, the element functions p_(si) and p_(ci) of the power supplyloss and cooling power to the device i can be expressed as shown inexpressions 6 and 7 (p_(si) and p_(ci) are expressed simply althoughthey are also the functions of the environmental information ε_(ι) andlocation χ_(ι) of the facility).p _(si) =P _(si)(p _(Di) ,x _(i))  [Expression 6]p _(Ci) =p _(Ci)(p _(Di) ,x _(i))  [Expression 7]

Although the facilities power functions p_(s) and p_(c) are functionsfor the entire devices and facilities like the expressions 2 and 3, ifthe power distribution of the devices and the environmental informationand locations of the facilities are not changed largely or not deflectedextremely, they may be considered as facilities element functions p_(si)and p_(ci) for each device separately by approximating an interactionand a nonlinear action. Alternatively, the facilities element functionmay be corrected so as to include the interaction between the devicesexisting relatively in the neighborhood. The device function p_(i) isthe sum of the facilities element functions p_(si) and p_(ci) and thedevice power function p_(Di) and can be expressed as shown in expression8. The objective function P is the total sum of the device functionsp_(i) of the entire devices and can be expressed as shown in expression9.p _(i) =p _(Di) +p _(Xi) +p _(Ci) =p _(Di)(l _(j))+p _(Si)(p _(Di)(l_(j)))+p _(Ci)(p _(Di)(l _(j)))  [Expression 8]

$\begin{matrix}{P = {\sum\limits_{i}{p_{i}\left( l_{j} \right)}}} & \left\lbrack {{Expression}\mspace{14mu} 9} \right\rbrack\end{matrix}$

When the objective functions P of the expressions 4 and 9 are compared,the facility powers p_(s) and p_(c) need to be obtained for the entirepower distribution of the devices in the case of the expression 4, butthe device function p_(i) only has to be obtained for each of thedevices in the case of the expression 9. Therefore, the calculation ofthe objective function P for each allocation of the workload issimplified, and the search for a solution can be performed efficiently.Also, if a specific table of the device function p_(i) is obtained, thesolution space can be narrowed down to the vicinity of an optimumsolution by using the coefficients of variables and the differentiationof the expressions as an index of the device to which the workloadshould be allocated with priority.

Still another feature of the present invention lies in that thecombinational optimization problem of allocating the workloads to thedevices is solved with using the admissibility workload condition of thedevices and the admissibility power condition of the facilities asconstraint conditions, thereby extracting an executable solution fromcombinations to obtain a solution efficiently. At the same time, byconforming to the constraint condition, the performances of the devicesand facilities are exerted efficiently and failures due to excessivepower or a temperature rise are prevented, thereby improving thereliability.

If a workload exceeding the maximum performance or maximum resource of adevice is allocated, the processing time for the workload is extended toincrease the amount of electric power (electric power×time). Thus, theadmissibility workload condition of a device is set up in considerationof the margin for the changes of the workload. Also, as a set ofvariables l_(j) which indicates a workload in the device power function,a factor affecting electric power is mainly selected. However, even thefactor which scarcely affects the electric power is sometimes importantfor the performance of the device or resource. For example, thosefactors are memory capacity of the device, disk capacity, I/O throughputcapacity and the like. These factors are handled as the admissibilityworkload conditions for determining whether or not an allocation of theworkload is acceptable separately from the device power function.

The power supply facility has a rated power for the power supply, powerdistribution panel and distributor depending on the power supply system,and it is necessary to conform to an admissibility power condition setwith the rated power as an upper limit. If a power supply system doesnot conform to this condition, it is necessary to reduce the workload ofthe devices connected to this power supply system or limit the electricpower of the devices. The cooling facility has a rated processingcapacity such as air conditioners, localized cooling units,liquid-cooling devices, chillers and cooling towers, and the power ofthe devices need to be lower than the capacity. Also, for the coolingfacilities, an admissibility power condition can be set for the area ofspace, sections and rack rows in which the devices are arranged in orderto keep the device in the operation temperature range and to avoid anexcessive concentration of heat generation to raise the coolingefficiency.

Still another feature of the present invention lies in that the powerconsumption to the locations of the devices or electric powerdistribution is obtained based on an optimum solution or approximationsolution obtained by solving the workload allocation problem to devicesand layout information, thereby controlling the power supply facilityand cooling facility. Accordingly, the operation efficiency of thefacilities can be improved and power supply loss and cooling power canbe suppressed. For example, in the power supply facility, the number ofoperating machines connected in parallel is changed in accordance withthe output power, thereby improving the power supply efficiency, and inthe cooling facility, the supply temperature of the air and refrigerant,the air amount and air flow direction of intake/exhaust ports and fans,and the temperature and flow rate of chillers and cooling towers and thelike are adjusted in accordance with the heat generation distribution,thereby improving the cooling efficiency.

Still another feature of the present invention lies in that avirtualization environment, job scheduler, SAN boot environment andoperations management are used as means for allocating the workloads tothe devices. These means may be selected by considering the timing orcycle of workload allocation, overhead and loss time accompanied by themovement of the workload, change and generation or extinction of theworkload, link of the device to the workload, acquirable operatinginformation of a device, easiness of introduction to an existing or newsystem, security and reliability of the system and the like, and may bemixed in parallel or hierarchically. The workloads are allocated to thedevices based on the arrangement of virtual devices to physical devicesin the case of the virtualization environment, based on the arrangementof jobs to the devices in the case of the job scheduler, based on thearrangement of the devices to be activated in the case of the SAN bootenvironment, and based on the arrangement of the devices to be operated,idled or stopped in the case of the operations management.

Still another feature of the present invention lies in that the devicesare operated so as to reduce the total power of the devices andfacilities in reflection of the changes in allocation of the workloadsto the devices. In the server units, software for providing workloadssuch as applications, virtual machines and jobs is moved. In the storageunits, data having a high access frequency is moved or copied, wherebythe workload is moved to the moving destination. In the network unit,the network connecting configuration is changed, whereby its operationnode is changed.

The effects obtained by typical one of the inventions disclosed in thisapplication will be briefly described below. For example, in theinformation-processing system like a data center, the total powerconsumption of the devices and facilities can be reduced by operationsmanagement in which the information-processing devices and thefacilities are linked with each other.

BRIEF DESCRIPTIONS OF THE DRAWINGS

FIG. 1 is a configuration diagram showing an operations managementdevice and an operations management method in an information-processingsystem according to the first embodiment of the present invention;

FIG. 2 is a configuration diagram showing an operations managementdevice and an operations management method in an information-processingsystem according to the second embodiment of the present invention;

FIG. 3 is a layout diagram showing layout information in an operationsmanagement method of an information-processing system according to thethird embodiment of the present invention;

FIG. 4 is a numerical table indicating operating information ofinformation-processing devices in an operations management method of aninformation-processing system according to the fourth embodiment of thepresent invention;

FIG. 5 is a graph showing a device power function in an operationsmanagement method of an information-processing system according to thefourth embodiment of the present invention;

FIG. 6 is a graph showing a device power function in an operationsmanagement method of an information-processing system according to thefourth embodiment of the present invention;

FIG. 7 is an explanatory diagram showing a facilities power function inan operations management method of an information-processing systemaccording to the fifth embodiment of the present invention;

FIG. 8 is a configuration diagram showing an operations managementdevice and an operations management method in an information-processingsystem according to the sixth embodiment of the present invention;

FIG. 9 is a configuration diagram showing an operations managementdevice and an operations management method in an information-processingsystem according to the seventh embodiment of the present invention;

FIG. 10 is a configuration diagram showing an operations managementdevice and an operations management method in an information-processingsystem according to the eighth embodiment of the present invention;

FIG. 11 is an explanatory diagram showing an operations managementmethod in an information-processing system according to the eighthembodiment of the present invention; and

FIG. 12 is an explanatory diagram showing an operations managementmethod in an information-processing system according to the eighthembodiment of the present invention.

DESCRIPTIONS OF THE PREFERRED EMBODIMENTS

Hereinafter, embodiments of the present invention will be described indetail with reference to the accompanying drawings. Components havingthe same function are denoted by the same reference numbers throughoutthe drawings for describing the embodiments, and the repetitivedescription thereof will be omitted. In the embodiments described below,the invention will be described in a plurality of sections orembodiments when required as a matter of convenience. However, thesesections or embodiments are not irrelevant to each other unlessotherwise stated, and the one relates to the entire or a part of theother as a modification example, details, or a supplementary explanationthereof.

Also, in the embodiments described below, when referring to the numberof elements (including number of pieces, values, amount, range, and thelike), the number of the elements is not limited to a specific numberunless otherwise stated or except the case where the number isapparently limited to a specific number in principle, and the numberlarger or smaller than the specified number is also applicable. Further,in the embodiments described below, it goes without saying that thecomponents (including element steps) are not always indispensable unlessotherwise stated or except the case where the components are apparentlyindispensable in principle. Similarly, in the embodiments describedbelow, when the shape of the components, positional relation thereof,and the like are mentioned, the substantially approximate and similarshapes and the like are included therein unless otherwise stated orexcept the case where it can be conceived that they are apparentlyexcluded in principle. The same goes for the numerical value and therange described above.

First Embodiment

FIG. 1 is a configuration diagram showing an operations managementdevice and an operations management method in an information-processingsystem according to the first embodiment of the present invention. Theinformation-processing system 10 includes information-processing devices20 ₁ to 20 _(n), power supply facilities 40 ₁ to 40 _(u) for supplyingpower to the devices 20 ₁ to 20 _(n), cooling facilities 50 ₁ to 50 _(v)for cooling the devices 20 ₁ to 20 _(n), and an operations managementdevice 60 for managing the devices 20 ₁ to 20 _(n), the power supplyfacilities 40 ₁ to 40 _(u) and the cooling facilities 50 ₁ to 50 _(v).

Workloads 30 ₁ to 30 _(m) are allocated to the devices 20 ₁ to 20 _(n).As for the workloads 30 ₁ to 30 _(m), like an example shown in FIG. 1, asingle workload is allocated to the device (device 20 _(n-1) andworkload 30 _(m-2)), a plurality of the workloads are allocated (device20 ₁ and workloads 30 ₁ to 30 ₂, device 20 ₃ and workloads 30 ₃ to 30 ₅device 20 _(n) and workloads 30 _(m-1) to 30 _(m)), and no workload isallocated (device 20 ₂).

The operations management device 60 includes means 63, which isconnected to the devices 20 ₁ to 20 _(n) and the facilities 40 ₁ to 40_(u) and 50 ₁ to 50 _(v) and has layout information constituted of thelocations and operating information 61 of the devices 20 ₁ to 20 _(n)and the locations and environmental information 62 of the facilities 40₁ to 40 _(u) and 50 ₁ to 50 _(v) so as to obtain the power consumptionof the devices 20 ₁ to 20 _(n), means 64 which obtains a power supplyloss of the power supply facilities 40 ₁ to 40 _(u) and a cooling powerof the cooling facilities 50 ₁ to 50 _(v) and means 65 which obtains anallocation of the workloads 30 ₁ to 30 _(m) to the devices 20 ₁ to 20_(n). The operations management device 60 is realized by, for example,programming process using a computer system.

In the operations management method of the first embodiment, theoperations management device 60 communicates with the devices 20 ₁ to 20_(n) and the facilities 40 ₁ to 40 _(u) and 50 ₁ to 50 _(v), therebycollecting the operating information of the devices 20 ₁ to 20 _(n) andthe environmental information of the facilities 40 ₁ to 40 _(u) and 50 ₁to 50 _(v) to acquire layout information 61 and 62. The operationsmanagement device 60 obtains the power consumption of the devices 20 ₁to 20 _(n) with respect to the workloads 30 ₁ to 30 _(m) based on theoperating information 61 of the devices 20 ₁ to 20 _(n) by the means 63,obtains power supply loss of the power supply facilities 40 ₁ to 40 _(u)and the cooling power of the cooling facilities 50 ₁ to 50 _(v) based onthe locations of the devices 20 ₁ to 20 _(n), the power consumptionobtained by the means 63, the locations of the facilities 40 ₁ to 40_(u) and 50 ₁ to 50 _(v) and the environmental information 62 by themeans 64, and obtains allocations of the workloads 30 ₁ to 30 _(m) tothe devices 20 ₁ to 20 _(n) so as to reduce the total power consumptionof the devices 20 ₁ to 20 _(n) and the facilities 40 ₁ to 40 _(u) and 50₁ to 50 _(v) based on the means 63 and 64.

The location information of the devices 20 ₁ to 20 _(n) included in thelayout information 61 is composed of the location coordinates of eachdevice or identification data for identifying the location, and includesconnecting configuration data between devices according to need. Theoperating information of the devices 20 ₁ to 20 _(n) is composed of dataindicating a workload amount and data indicating power consumption orthe like and includes, for example, performance, resource utilization,operating/stop state, rated power or measured power, and operatingtemperature. The workload amount data is general-purpose measurementwhich can be exchanged between devices and not dependent of anyparticular device, workload, and a relation between a device and aworkload. The power consumption data is a numerical value, expression ornumerical table which expresses directly or indirectly the powerconsumption characteristic of the device with respect to the workloadamount, and it depends on the respective devices.

The location information of the facilities 40 ₁ to 40 _(u) and 50 ₁ to50 _(v) included in the layout information 62 is composed of thelocation coordinates of each facility or identification data foridentifying the location and the connecting configuration data betweenfacilities. The environmental information of the facilities 40 ₁ to 40_(u) and 50 ₁ to 50 _(v) is composed of the operating data and operationcharacteristic data of the facilities and monitoring data of asurrounding environment, and includes, for example, electric power,temperature, humidity, flow rate, flow direction, rated power and ratedperformance. The operation characteristic data is a numerical value,expression or numerical table which expresses the power supply losscharacteristic to a power load in the case of the power supplyfacilities and the power consumption characteristic to heat load in thecase of the cooling facilities. Note that the operating information ofthe devices 20 ₁ to 20 _(n) and the environmental information of thefacilities 40 ₁ to 40 _(u) and 50 ₁ to 50 _(v) can supplement each otherlike electric power data of a temperature data facility of the device.

In the means 63 for obtaining power consumption of the devices 20 ₁ to20 _(n), as one method, a given workload amount is verified with a knownnumeric data each time, and a power consumption is calculated byinterpolation and statistical processing. As another method, therelationship of device power with respect to the workload amount ispreliminarily formulated with using the workload amount as a variable orturned into a routine for outputting a return value from a numericaltable with using the workload amount as an argument. In the formermethod, verification and calculation take much time as the operatinginformation of the devices 20 ₁ to 20 _(n) is accumulated, but thecalculation accuracy is improved. In the latter method, by correctingthe relational expression and numerical table with an accumulation ofthe operating information, required time can be suppressed while theaccuracy is raised, and further, the relation between the workloadamount and the device electric power can be grasped with a good view.

In the means 64 for obtaining the power consumption of the facilities 40₁ to 40 _(u) and 50 ₁ to 50 _(v), as one method, simulation is carriedout each time to calculate a power supply loss and cooling power basedon the locations of the devices 20 ₁ to 20 _(n) in the layoutinformation 61, the power consumption of the devices 20 ₁ to 20 _(n)obtained by the means 63 and the locations and environmental informationof the facilities 40 ₁ to 40 _(u) and 50 ₁ to 50 _(v) in the layoutinformation 62. As another method, a detailed simulation is carried outon a presumed condition preliminarily and linear approximation isexecuted, whereby a relation of element power of the facility withrespect to the location and power of each device is obtained in the formof a numeric expression, numerical table or simple simulator. The formermethod can obtain a high accuracy if a calculation time is allowed. Thelatter method can shorten the calculation time while ensuring theaccuracy within the presumed condition because the detailed simulationcan be completed in advance.

There are some methods for the means 65 for obtaining an allocation ofthe workloads 30 ₁ to 30 _(m) to the devices 20 ₁ to 20 _(n). As onemethod, the power of the devices and power of the facilities arecalculated each time for the combinations of the workload allocations tothe devices by the means 63 and 64, and an allocation solution whichminimizes the total power is selected by comparing calculation resultsof the combinations. As another method, a priority order index in theworkload allocation is derived from the relation of the device power tothe workload amount preliminarily obtained by the means 63 and therelation of the facilities element power to the power distribution ofthe devices preliminarily obtained by the means 64, and workloads areallocated to the devices along the index. The former method is suitablefor obtaining an optimum solution which minimizes the total power whenthere are few combinations, and the latter method is suitable forobtaining an optimum solution or an approximation solution fast whenthere are a number of combinations. In the latter method, it ispermissible that the power distribution of the devices to an obtainedallocation solution is calculated in accordance with the accuracy of thesolution and calculation time, a relation of the facilities elementpower to this is obtained again, an index is derived by using therelation to obtain the workload allocation again, and then thisprocedure is repeated until the anterior and posterior allocationsolutions converge within a predetermined condition.

In the operations management method of the information-processing system10 according to the first embodiment, since the layout informationcomposed of the locations of the devices 20 ₁ to 20 _(n) and theoperating information 61 and the locations of the facilities 40 ₁ to 40_(u) and 50 ₁ to 50 _(v) and the environmental information 62 isprovided, an optimum solution for allocating the workloads 30 ₁ to 30_(m) to the devices 20 ₁ to 20 _(n) is obtained and thus an effect ofreducing the total power consumption including the power consumption ofthe devices 20 ₁ to 20 _(n) and the power supply loss or cooling powerof the facilities 40 ₁ to 40 _(u) and 50 ₁ to 50 _(v) can be achieved.Further, by updating the workload allocation to the devices 20 ₁ to 20_(n) in accordance with a desired opportunity or plan, input of a newworkload, termination of existing workload and the like, the energysaving operation of the information-processing system 10 can beachieved.

Although the information-processing system 10 is typified by data centerand computer room, this embodiment can be applied to the operationsmanagement systems of industrial facility, commercial facility,communication facility and transportation facility. Further, thisembodiment is applicable not only to operations management of existingsystem but also as a design/diagnostic tool for system installation,extension, relocation and repair. Also, this embodiment can be appliedto even a system stretched over a plurality of facilities or places byremote control.

The information-processing devices 20 ₁ to 20 _(n) include a serverunit, storage unit, network unit and the like. The server unit includesa general-purpose server, specialized server, main frame, parallelcomputers, super computer, built-in computer and personal computer, andthe storage unit includes a magnetic disk, fixed disk, optical disk andtape. The network unit includes a rooter, switch and hub, and peripheralunits include a printer, copier, modem and display. Further, thisembodiment can be applied to a unit having demand-based switchingfunction for operation, waiting, idle and stop states, that is, energysaving mode. This corresponds to DBS in the server, MAID in the storage,and a port power supply control in the network. As for the hardwarestyle, this embodiment can be applied to various types including a bladetype, rack mount type, tower type and special casing type.

The workloads 30 ₁ to 30 _(m) refer to applications for the server unit,access data for the storage unit and transfer data for the network unit.The workload amount data refers to performance, resource utilization andoperating/idle state for the server unit, a number of activated disks,access pattern and access time for the storage unit, and a number oftransfer packets and switching frequency for the network unit. Also, asthe workload type, by classifying fixed/floating decimal pointoperation, transaction processing, database processing, technicalcomputation, format and granularity of data, and guaranteed band, thepower consumption characteristic of the device can be taken intoconsideration.

The power supply facilities 40 ₁ to 40 _(u) include an electrictransformer, uninterruptible power supply system, power distributionpanel, distributor and a power supply of a rack in which devices aremounted, and a power sensor, current/voltage sensor and leak sensor arealso included therein. Further, depending on a case, a power plant,power transmission facility, transformation facility for the powersupply and a power source of a device to which power is to be suppliedare also included therein. The cooling facilities 50 ₁ to 50 _(v)include air conditioner, chiller, cooling tower, intake/exhaust port,fan, duct and refrigerant pipe, and a temperature sensor, humiditysensor and flow rate/flow direction sensor disposed indoor and outdoorare also included therein. Further, depending on a case, aliquid-cooling device, localized cooling device for a rack row and rackfront/rear faces and cooling unit of the device are also includedtherein.

The operations management device 60 is provided with a common managerserver for both the information-processing devices 20 ₁ to 20 _(n) andthe facilities 40 ₁ to 40 _(u) and 50 ₁ to 50 _(v). Alternatively, themanager servers of the both may be linked and the manager function maybe assumed by a part of the devices 20 ₁ to 20 _(n). The operationsmanagement method of this embodiment can be installed as software suchas middleware, application, built-in control software and firmware, andfor example, an engine for solving the optimization problem can beinstalled as hardware. In order for the manager to acquire the operatinginformation of the devices and the environmental information of thefacilities, each device and facility are provided with an agent, serviceprocessor and interface, or the devices and facilities may establishautonomous distribution system. Note that, since the effect of reducingthe total power of the devices and facilities in this embodiment isexerted by the layout information indicating the locations and theoperating information of the devices and the locations and theenvironmental information of the facilities, the means for obtaining thepower consumption of the devices, the means for obtaining the powerconsumption of the facilities and the means for obtaining the workloadallocation to the devices, it is not limited by the devices shown in thefirst embodiment and FIG. 1, any calculation procedures and others.

Second Embodiment

FIG. 2 is a configuration diagram showing an operations managementdevice and an operations management method in an information-processingsystem according to the second embodiment of the present invention. Theinformation-processing system 110 includes information-processingdevices 120 ₁ to 120 _(n), power supply facilities 140 ₁ to 140 _(u) forsupplying power to the devices 120 ₁ to 120 _(n) cooling facilities 150₁ to 150 _(v) for cooling the devices 120 ₁ to 120 _(n), and operationsmanagement devices 160 ₁ and 160 ₂ for managing the devices 120 ₁ to 120_(n) the facilities 140 ₁ to 140 _(u) and 150 ₁ to 150 _(v), andworkloads 130 ₁ to 130 _(m) are allocated to the devices 120 ₁ to 120_(n).

The operations management device 160 ₁ is connected to the devices 120 ₁to 120 _(n) so as to monitor the operating information of the devices120 ₁ to 120 _(n), and has layout information 161 composed of thelocations and operating information of the devices 120 ₁ to 120 _(n),and it includes means 163 for obtaining power consumption of the devices120 ₁ to 120 _(n), means 165 for obtaining an allocation of virtualworkloads 130 ₁ to 130 _(m) to the devices 120 ₁ to 120 _(n), and means168 for allocating real workloads 130 ₁ to 130 _(m) to the devices 120 ₁to 120 _(n). An operations management device 160 ₂ is connected tofacilities 140 ₁ to 140 _(u) and 150 ₁ to 150 _(v) so as to monitor theenvironmental information of the facilities 140 ₁ to 140 _(u) and 150 ₁to 150 _(v), and has layout information 162 composed of the locationsand environmental information of the facilities 140 ₁ to 140 _(u) and150 ₁ to 150 _(v), and it includes means 164 for obtaining the powersupply loss of the power supply facilities 140 ₁ to 140 _(u) and thecooling power of the cooling facilities 150 ₁ to 150 _(v) and means 169for giving an operation instruction to the facilities 140 ₁ to 140 _(u)and 150 ₁ to 150 _(v).

In the operations management method according to the second embodiment,the operations management device 160 ₁ on the device side and theoperations management device 160 ₂ on the facility side are linked witheach other so as to exchange necessary data between the operationsmanagement devices 160 ₁ and 160 ₂. In the operations management device160 ₁, a relation of power consumption of the devices 120 ₁ to 120 _(n)to the workload is obtained based on the operating information 161 ofthe devices 120 ₁ to 120 _(n) by the means 163. In the operationsmanagement device 160 ₂, a relation between the power supply loss of thepower supply facilities 140 ₁ to 140 _(u) and the cooling power of thecooling facilities 150 ₁ to 150 _(v) with respect to the locations andpower consumption of the devices 120 ₁ to 120 _(n) obtained from theoperations management device 160 ₁ is obtained based on the layoutinformation 162 of the facilities 140 ₁ to 140 ₁ and 150 ₁ to 150 _(v)obtained by the operations management device 160 ₂ by the means 164.

Further, in the operations management device 160 ₁, based on therelation of the device power with respect to the workload in the means163 and the relation of the facility power with respect to the devicepower distribution in the means 164, an allocation solution of thevirtual workloads to the devices 120 ₁ to 120 _(n) is derived so as toconform to the constraint condition 166 of the devices 120 ₁ to 120 _(n)or the facilities 140 ₁ to 140 _(u) and 150 ₁ to 150 _(v) and theoperation policy 167 to the workloads 130 ₁ to 130 _(m) and to minimizethe total power consumption of the devices 120 ₁ to 120 _(n) and thefacilities 140 ₁ to 140 _(u) and 150 ₁ to 150 _(v) by the means 165.Upon reception of the result, the operations management device 160 ₁allocates real workloads to the devices 120 ₁ to 120 _(n) by the means168 at an appropriate timing, and the operations management device 160 ₂gives an operation instruction to the facilities 140 ₁ to 140 _(u) and150 ₁ to 150 _(v) based on a power distribution of the devices 120 ₁ to120 _(n) and the layout information 162 by the means 169.

In the operations management method of the information-processing system110 of the second embodiment, the means 165 for obtaining the allocationsolution of the virtual workloads to the devices 120 ₁ to 120 _(n) cancalculate scheduled or estimated workloads in addition to the currentworkloads 130 ₁ to 130 _(m) as the virtual workloads and make adetermination with respect to the constraint condition 166 and theoperation policy 167 including a time passage from the present with agood view. Consequently, a divergence from the optimum solution in thereal workload allocation, failures due to violation of the condition andoverhead due to complicated repairs can be avoided. Further, by theseparation into the virtual workload allocation by the means 165 and thereal workload allocation by the means 168, a timing for executing anallocation change by the means 168 and a timing for giving the operationinstruction to the facilities 140 ₁ to 140 _(u) and 150 ₁ to 150 _(v) bythe means 169 can be set up appropriately with taking into account atime required for the derivation of an allocation solution in additionto forecast of the workload.

The constraint condition 166 includes the admissibility workloadcondition considering the operating temperature of the devices 120 ₁ to120 _(n), maximum workload and a margin for the changes in the workload,the admissibility power condition considering the rated power of thepower supply facilities 140 ₁ to 140 _(u) and power supply efficiency,and the admissibility power condition among sections and devices in theneighborhood considering the rated performance of the cooling facilities150 ₁ to 150 _(v) and the flow rate/flow direction. The contentsdescribed in the operation policy 167 include the priority order of theworkload, execution timing, processing period, schedule, resourcedistribution of the devices 120 ₁ to 120 _(n) to the workloads, servicelevel and power cost. By providing the constraint condition 166 and theoperation policy 167 first at a stage of allocating the virtualworkloads to the devices 120 ₁ to 120 _(n) by the means 165, turn-backcan be eliminated in comparison with the case of verifying theconstraint condition 166 and the operation policy 167 after anallocation solution is once obtained, and a solution can be obtainedefficiently because candidates can be narrowed down from thecombinations of the virtual workload allocations. In addition, faultsand failures of the devices 120 ₁ to 120 _(n) and the facilities 140 ₁to 140 _(u) and 150 ₁ to 150 _(v) can be avoided by the constraintcondition 166, and advanced operations management which can achieve boththe energy saving and the service improvement can be realized by theoperation policy 167.

In the second embodiment, by providing the operations management device160 ₁ on the device side and the operations management device 160 ₂ onthe facility side, the calculation processings of the both are separatedto avoid the complication thereof, and closely coordinated operation isachieved through an interface therebetween. Although high speedoperation can be done by distributed processing if installing the bothon separate manager servers, the both may be installed in a commonmanager server if a sufficient calculation performance is provided.Also, according to the second embodiment, an operation instruction canbe given to the facilities 140 ₁ to 140 _(u) and 150 ₁ to 150 _(v) inadvance based on the power distribution of the devices 120 ₁ to 120_(n). Therefore, compared with a case of controlling the facilitiespassively like in the prior art, the necessity of providing an excessivemargin is eliminated, and thus an efficient operation without waste canbe performed.

Third Embodiment

FIG. 3 is a layout diagram showing layout information in an operationsmanagement method of an information-processing system according to thethird embodiment of the present invention, in which an example of thedisplay screen of the operations management device described in thefirst embodiment and the second embodiment is shown. Theinformation-processing system 210 includes information-processingdevices, rack rows 220 ₁ to 220 ₁₀ in which the devices are mounted,power supply facilities composed of an electric transformer 240, anun-interruptible power supply system 241 and power distribution panels242 ₁ to 242 ₄, and cooling facilities composed of a cooling tower 250,a chiller 251, air conditioners 252 ₁ and 252 ₆ and a grille 253.

In the power supply facility, power is supplied from the electrictransformer 240 through the uninterruptible power supply system 241 andthe power distribution panels 242 ₁ to 242 ₄ to the rack rows 220 ₁ to220 ₁₀, and further supplied from the power distribution unit of therack row to the information-processing device. The cooling facilityexecutes underfloor air conditioning and the air conditioners 252 ₁ to252 ₆ supply cooling air through the grilles 253 (though they are pluralin number but represented with a single symbol) to suck hot airgenerated by the heat of the devices. Further, the air conditioners 252₁ to 252 ₆ exchange heat with the chiller 251 and the cooling tower 250,and the cooling tower 250 radiates heat to the outside.

The layout of the third embodiment corresponds to the layout informationin which the location coordinates and operating information of thedevices and the location coordinates and environmental information ofthe facilities are mapped, and it is obtained by reproducing andvisualizing the real space information where the devices and thefacilities are installed on a virtual space of the operations managementdevice. The layout information indicates the arrangement of the devicesin a room (not shown in FIG. 3 because this is an entire diagram) andthe arrangement of the rack rows 220 ₁ to 220 ₁₀, the power distributionpanels 242 ₁ to 242 ₄, the air conditioners 252 ₁ to 252 ₆ and thegrilles 253, as well as a connecting configuration of power supplysystem from the electric transformer 240 existing outdoor and theuninterruptible power supply system 241 to the power distribution panels242 ₁ to 242 ₄ and the rack rows 220 ₁ to 220 ₁₀ and a connectingconfiguration of a heat exchange system composed of the cooling tower250 existing outdoor, the chiller 251 and the air conditioners 252 ₁ to252 ₆.

In the third embodiment, various indications are enabled by clickingbuttons 260 to 263, 270 to 275, 280 and 281 on the display screen. Theworkload indication button 260 can display a workload distribution ofthe devices. The kinds of devices such as the server, storage andnetwork and the workload amount are indicated with the colors anddensity of images for each of the rack rows 220 ₁ to 220 ₁₀ in the caseof the overall display of the layout and for each of the devices in thecase of the zoom-in display. By touching the devices with a mouse,detailed data of the workload is shown by a pop-up window. In the pop-upwindow, the specification of the device, configuration and resourceinformation can be displayed in accordance with the operation of a mouseor a keyboard.

Similarly, the power indication button 261 displays the powerconsumption distribution for each of the rack rows 220 ₁ to 220 ₁₀ andeach of the devices, the output power or power supply loss of theelectric transformer 240, the uninterruptible power supply system 241and the power distribution panels 242 ₁ to 242 ₄ and the powers of thecooling tower 250, the chiller 251 and the air conditioners 252 ₁ to 252₆, and at the same time, the total power of the devices and facilitiesare displayed in numerical values. The temperature indication button 262displays the temperature distribution of sensors dispersed in a room,the operating temperature of the devices, the intake/exhaust temperatureof the rack rows 220 ₁ to 220 ₁₀, the supply/discharge air temperatureof the air conditioners 252 ₁ to 252 ₆, the supply air temperature ofthe grille 253, the supply/discharge air temperature of refrigerant inthe cooling tower 250 and the chiller 251 and the external airtemperature. The failure indication button 263 displays a failure of thedevices or facilities and further an alarm with respect to the operatingtemperature condition and admissibility workload condition of thedevices and the admissibility power condition of the devices andfacilities and its contents.

FIG. 3 is a layout diagram viewed in an xy plane, and its plane can bechanged with the buttons 270 to 275. The button 270 specifies an xyplane display. The button 271 selects whether the xy plane is to bedisplayed along the entire z axis or the xy plane is to be cut out byspecifying a particular z coordinate. The same goes for the buttons 272to 275. Three-dimensional space information can be displayed byswitching the button 270 for the xy plane, the button 272 for the yzplane and the button 274 for the zx plane. The buttons 280 and 281 areused for zoom-in display and zoom-out display, and the former indicatesa detailed condition of the devices and facilities and the latterindicates an entire condition. In addition, three-dimensional displaymay be carried out if required for grasping the entire situation in apanoramic view.

In the layout information of the third embodiment, the operatingsituation of the devices and the environmental information of thefacilities in a real space in which the devices and facilities areinstalled can be grasped collectively by visualization, and the workloadallocation of the devices and the operation instruction for thefacilities as described in the first embodiment and the secondembodiment can be linked integrally and closely based on the layoutinformation. Not only the energy saving operation for reducing the totalpower consumption of the devices and facilities but also operationmonitoring, power control, business operation, failure detection andresource management of the devices and facilities can be handledcollectively, and therefore, the work efficiency of an operation managercan be improved. Further, since the efficiency, risk and cost of boththe devices and facilities of a current system can be diagnosed, itsresult can be used for planning and construction for moving, expansion,repair and updating of the system.

Fourth Embodiment

FIG. 4 is a numerical table showing operating information ofinformation-processing devices in an operations management method of aninformation-processing system according to the fourth embodiment of thepresent invention, in which an example of a case where theinformation-processing device is a server is shown. The operatinginformation of the server includes specification 300, configuration 310and operating information (or measuring information, operating history)320. For example, the operations management device as described in thefirst embodiment or the second embodiment has the specification 300,configuration 310 and operating information 320 of each device andmanages them as the same data file or different data files correlated toone another. Note that the items, order and combination of thespecification 300, configuration 310 and operating information 320 canbe modified as required.

The specification 300 includes a device management number,administrator, device name, product name, model number, processingperformance a, processing performance b, processing performance c, ratedpower (maximum), rated power (idle), rated temperature (maximum), ratedtemperature (minimum) and others. The configuration 310 includes a CPUmodel number, CPU maximum frequency, amount of CPUs, memory modelnumber, memory capacity, amount of memories, chip set model number, diskmodel number, disk capacity, amount of disks, I/O transfer rate, numberof I/Os and others. The operating information 320 includes devicelocation coordinate, workload type, device/CPU state, CPU operatingfrequency, CPU utilization, CPU operating temperature, memoryutilization, disk transfer rate, I/O transfer rate, device operatingpower, device intake temperature, device exhaust temperature and others.

In the fourth embodiment, a device power function as shown in expression1 is derived based on the specification 300, the configuration 310 andthe operating information 320. In a simple derivation method, forexample, the device power function p_(Di) (i=1, 2, . . . ) of the devicei can be expressed as shown in expression 10 where the rated power(maximum) of the specification 300 is p_(maxi), the rated power(minimum) is P_(idlei), the CPU maximum frequency of the configuration310 is f_(max), the CPU operating frequency of the operating information320 is f_(i), CPU utilization is α_(i) and f_(i)/f_(max)·α_(i) is set asa workload amount. If a plurality of the CPUs exist or the CPU has aplurality of cores, an average value between f_(i) and α_(i) may betaken for simplification.

$\begin{matrix}{p_{Di} \cong {{\left( {p_{\max\; i} - p_{idlei}} \right) \cdot \frac{f_{i}}{f_{\max\mspace{11mu} i}} \cdot \alpha_{i}} + p_{idlei}}} & \left\lbrack {{Expression}\mspace{14mu} 10} \right\rbrack\end{matrix}$

If no workload exists or no workload is allocated, the device powerfunction p_(Di) of a device i is p_(Di)=P_(idlei) according to theexpression 10 by assuming that the CPU utilization α_(i) is 0%. If thedevice/CPU state of the operating information 320 has a sleep state oran idle state, the power p_(Di) corresponding to each state under theCPU utilization α_(i)=0% may be defined. Further, when it is assumedthat a workload f_(i)/f_(max)·α_(i) is being performed in a device i anda device power in the case where it is moved to a device j is estimated,the workload f_(i)/f_(max)·α_(i) is replaced as shown in expression 11where the device performance a of the specification 300 is γ_(a), thedevice performance b is γ_(b), the device performance c is γ_(c) and theworkload type of the operating information 320 is w (w=a, b, c), and itis substituted into the device power function p_(Dj) of the device j.

$\begin{matrix}\left. {\frac{f_{i}}{f_{\max\mspace{11mu} i}} \cdot \alpha_{i}}\rightarrow{\frac{\gamma_{wi}}{\gamma_{wj}} \cdot \frac{f_{i}}{f_{\max\mspace{11mu} i}} \cdot \alpha_{i}} \right. & \left\lbrack {{Expression}\mspace{14mu} 11} \right\rbrack\end{matrix}$

If the workload amount γ_(wi)/γ_(wj)·f_(i)/f_(max)·α_(i) after thereplacement exceeds 100%, the power p_(Dj) of the device j to which theworkload is moved is assumed to be p_(Dj) and it may be considered thatthe processing time of the workload is extended (power amount isincreased) in accordance with the exceeding amount. Note that, althoughnot particularly limited, the workload type is for identifyingprocessing contents whose processing capacity is largely changeddepending on hardware architecture not by CPU frequency simply, such asfixed-point arithmetic processing, floating-point arithmetic processingand memory read/write processing. Further, although not particularlylimited, the device performance γ_(w) is a bench mark score of eachworkload type.

When the device operating power of the operating information 320 can beobtained as existing measuring information or operating history, theapproximate expression of the device power function p_(Di) can beobtained from the data of the workload amount f_(i)/f_(max)·α_(i) andthe device operating power P_(mensi). FIG. 5 shows an example in whichthese data are plotted and is a graph indicating approximated devicepower function p_(Di) The function p_(Di) can be expressed as shown inexpression 12 where the slope of the linear function is a_(Di) and theintercept is b_(Di). In the example of FIG. 5, the solid line indicatesan approximate function where a_(Di)=1.3175 and b_(Di)=152.16.

$\begin{matrix}{p_{Di} \cong {{a_{Di} \cdot \frac{f_{i}}{f_{\max\mspace{11mu} i}} \cdot \alpha_{i}} + b_{Di}}} & \left\lbrack {{Expression}\mspace{14mu} 12} \right\rbrack\end{matrix}$

When the device i executes demand-based switching of a plurality ofoperating states (CPU operating frequency, CPU core voltage) inaccordance with the workload as an energy saving function, the devicepower p_(Di) is changed in steps. In this case, by defining a linearfunction like expression 10 and expression 12 for each operating stateand workload amount range, the device power function p_(Di) can beexpressed as a function set. As another simple method, the device powerfunction p_(Di) changed in steps can be approximated with a singlequadratic function. FIG. 6 shows an example in which data of theworkload amount f_(i)/f_(max)·α_(i) and the device operating powerp_(measi) in the demand-based switching of the three states are plotted,and is a graph showing a secondarily approximated device power functionp_(Di). The function p_(Di) can be expressed as shown in expression 13where the coefficient of its secondary term is a_(Di), the coefficientof the primary term is b_(Di) and the constant term is c_(Di). In theexample of FIG. 6, the dotted line indicates a linear function changedin steps and the solid line indicates an approximated quadraticfunction, in which a_(Di)=0.0134, b_(Di)=0.7297 and c_(Di)=103.16.

$\begin{matrix}{p_{Di} \cong {{a_{Di} \cdot \left( {\frac{f_{i}}{f_{\max\mspace{11mu} i}} \cdot \alpha_{i}} \right)^{2}} + {b_{Di} \cdot \left( {\frac{f_{i}}{f_{\max\mspace{11mu} i}} \cdot \alpha_{i}} \right)^{2}} + c_{Di}}} & \left\lbrack {{Expression}\mspace{14mu} 13} \right\rbrack\end{matrix}$

When the device operating power p_(measi) of the device i cannot beacquired directly and the thermal resistance and thermal time constantare evident, the operating power p_(measi) can be derived indirectlyfrom the intake temperature and the exhaust temperature of the operatinginformation 320. The operating power p_(measi) can be expressed as shownin expression 14 where the thermal resistance is R_(thi), the thermaltime constant is τ_(thi), the intake temperature is T_(ini) and theexhaust temperature is T_(outi). Since the temperature is changed slowlywith the thermal time constant as compared with changes of the operatingpower, it is corrected in consideration of the slope of the temperaturechange.

$\begin{matrix}{p_{measi} \cong {\frac{1}{R_{thi}} \cdot \left\{ {\left( {T_{outi} - T_{ini}} \right) + {\tau_{thi} \cdot \frac{\mathbb{d}\left( {T_{outi} - T_{ini}} \right)}{\mathbb{d}t}}} \right\}}} & \left\lbrack {{Expression}\mspace{14mu} 14} \right\rbrack\end{matrix}$

When the device operating power p_(measi) is acquired indirectly, thedevice power function p_(Di) as shown in expression 12 and expression 13can be derived together with the measurement of f_(i)/f_(max)·α_(i) ofthe workload amount. Also, even when the thermal resistance R_(thi) andthe thermal time constant τ_(thi) are not evident at the beginning, ifthe rated power (maximum) p_(maxi) or the rated power (minimum)P_(idlei) is known, the thermal resistance R_(thi) and the thermal timeconstant τ_(thi) can be calculated from the measured data of the intaketemperature T_(ini) and the exhaust temperature T_(outi) and the slopedata of the temperature changes.

In the device power function of the fourth embodiment, the powerconsumption of the devices to a workload can be easily obtained and therelation between the workload amount and device power can be graspedwith a good view, so that the workload allocation to the devices can becarried out efficiently. Further, even when all the operatinginformation of the devices cannot be obtained, the device power functioncan be derived from a part of data as shown in expression 10 andexpression 14, and if the measuring information and the operatinghistory can be obtained, the device power function matched with anactual measurement can be derived as shown in expression 12 andexpression 13. Furthermore, if the measuring information and operatinghistory are accumulated, the approximation accuracy can be raised.

Although the server unit is exemplified in the fourth embodiment, thedevice power function can be derived from the device operatinginformation similarly even in the case of the storage unit or thenetwork unit. Although the CPU maximum frequency, the CPU operatingfrequency and the CPU utilization are used as main variables indicatingthe workload amount in the fourth embodiment, the number of activateddisks, access pattern and access time can be used in the case of thestorage unit, and the amount of transferred packets and switchingfrequency can be used in the case of the network unit.

Fifth Embodiment

FIG. 7 is an explanatory diagram of the facilities power function in theoperations management method of the information-processing systemaccording to the fifth embodiment of the present invention, in which theinformation-processing system 210 of the third embodiment is used as anexample. For example, when a device i 221 _(i) is located at a rack row220 ₇, the power supply facility supplies power to the device i from theelectric transformer 240 through the uninterruptible power supply system241 and the power distribution panel 242 ₃ as shown with the arrow 243.Electric power consumed by the device i 221 _(i) is transformed tosensible heat to warm the air. The cooling facility supplies cooling airto the device i 221 _(i) from the air conditioners 252 ₁ to 252 ₆through the underfloor and grille (in FIG. 7, illustration of the floortiles and grilles is omitted to facilitate seeing), and air heated bythe device i 221 _(i) is returned to the air conditioners 252 ₁ to 252 ₆as shown with arrows 254 ₁ to 254 ₆, so that heat absorbed by the airconditioners 252 ₁ to 252 ₆ is discharged to the external air throughthe chiller 251 and the cooling tower 250.

If the location coordinates and the device power or device powerfunction are known over the entire devices like the device i, the powersupply loss of the power supply facilities and the cooling power of thecooling facilities can be calculated. If the location coordinate of thedevices is obtained from the operating information 320 and the devicepower function as shown in expression 10, expression 12 and expression13 is obtained like in the fourth embodiment, the power distribution ofthe entire devices can be obtained, and the facility power can becalculated with the facilities power functions p_(s) and p_(c) as shownin expressions 2 and 3 with using them as inputs. For the calculation ofthe facilities power functions p_(s) and p_(c), a simulator in whichenvironmental information such as the location coordinate of thefacility, connecting configuration and operating characteristic areinputted preliminarily can be used.

Further, in order to obtain the facility power simply, linearapproximation is carried out within the range of a predeterminedcondition, thereby disassembling the facilities power functions p_(s)and p_(c) into the facilities element functions p_(si) and p_(ci) asshown in expressions 6 and 7. The facilities power functions p_(s) andp_(c) are liner sums of the element functions p_(si) and p_(ci) of eachdevice over the entire devices. The element function p_(si) of the powersupply facility for the device i is obtained by performing a preliminarysimulation along the power supply system indicated by an arrow 243. Theelement function p_(ci) of the cooling facility is obtained byperforming a preliminary simulation in consideration of influences ofthermal load which the device i gives to the air conditioners 252 ₁ to252 ₆ as shown by arrows 254 ₁ to 254 ₆. In the simulation, thesensitivity coefficient of the power supply/cooling facility power iscalculated by changing the power to the device i. In the simplifiedcase, the facilities element functions p_(si) and p_(ci) can beexpressed with a linear function as shown in expressions 15 and 16 wherethe slopes are a_(si) and a_(ci) and the intercepts are b_(si) andb_(ci).p _(Si) ≅a _(Si) ·p _(Di) +b _(Si)  [Expression 15]P _(Ci) ≅a _(Ci) ·p _(Di) +b _(Ci)  [Expression 16]

If the facilities element functions p_(si) and p_(ci) are determined,the device function p_(i) as shown in expression 8 can be derived bytaking the sum with the device power function p_(Di). The devicefunction p_(i) indicates a device power and facility power applied toeach device. For example, if the device power function p_(Di) shown inexpression 12 described in the fourth embodiment is used, the devicefunction p_(i) can be expressed as shown in expression 17. The slopea_(i) and intercept b_(i) of the device function p_(i) are definednewly. The total power consumption P of the devices and facilities is atotal sum of the device functions p_(i) of the entire devices, and theexpression 9 can be rewritten into the expression 18.

$\begin{matrix}{{p_{i} = {{p_{Di} + p_{Si} + p_{Ci}} = {{a_{i} \cdot \left( {\frac{f_{i}}{f_{\max\mspace{11mu} i}} \cdot \alpha_{i}} \right)} + b_{i}}}}{a_{i} = {a_{Di} \cdot \left( {1 + a_{Si} + a_{Ci}} \right)}}{b_{i} = {{b_{Di} \cdot \left( {1 + a_{Si} + a_{Ci}} \right)} + b_{Si} + b_{Ci}}}} & \left\lbrack {{Expression}\mspace{14mu} 17} \right\rbrack \\{P = {{\sum\limits_{i}p_{i}} = {\sum\limits_{i}\left\{ {{a_{i} \cdot \left( {\frac{f_{i}}{f_{\max\mspace{11mu} i}} \cdot \alpha_{i}} \right)} + b_{i}} \right\}}}} & \left\lbrack {{Expression}\mspace{14mu} 18} \right\rbrack\end{matrix}$

As is evident from the expression 18, by optimizing the allocation ofthe workloads (f_(i)/f_(max)·α_(i)) to the devices, the total power P ofthe devices and facilities can be minimized. More specifically, acombination optimization problem for allocating the workloads to thedevices is solved so as to minimize the objective function P. Since thenumber of the combinations is enormous as shown in expression 5 if thereare a number of the devices, it is not realistic to search all thecombinations. In the fifth embodiment, since the objective function P ofthe expression 18 is turned into a linear sum of the linear functions byan appropriate approximation, an optimum solution can be found outefficiently with using the slope a_(i) and the intercept b_(i) of thedevice function p_(i) as indexes.

Sixth Embodiment

FIG. 8 is a configuration diagram showing the operations managementdevice and operations management method of the information-processingsystem according to the sixth embodiment of the present invention. Aninformation-processing system 410 includes physical servers 420 ₁ to 420_(n), power supply facilities 440 ₁ to 440 _(n) for supplying power tothe servers 420 ₁ to 420 _(n), cooling facilities 450 ₁ to 450 _(v) forcooling the servers 420 ₁ to 420 _(n) and an operations managementdevice 460 for managing the servers 420 ₁ to 420 _(n) and the facilities440 ₁ to 440 _(u) and 450 ₁ to 450 _(v), and a virtual environment isformed. Virtual machines 430 ₁ to 430 _(m) are disposed on the physicalservers 420 ₁ to 420 _(n) via hypervisors 421 ₁ to 421 _(n), and OS 431₁ to 431 _(m) and applications 432 ₁ to 432 _(m) as the workloads areoperated thereon. In the operations management device 460, avirtualization manager 462 for managing the physical servers 420 ₁ to420 _(n) and the virtual machines 430 ₁ to 430 _(m), a facility manager463 for managing the facilities 440 ₁ to 440 _(u) and 450 ₁ to 450 _(v)and an operations manager 461 for reducing the total power consumptionof the servers 420 ₁ to 420 _(n) and the facilities 440 ₁ to 440 _(u)and 450 ₁ to 450 _(v) are operated in coordination.

In the sixth embodiment, the virtualization manager 462 managesallocation of the virtual machines 430 ₁ to 430 _(m) to the physicalservers 420 ₁ to 420 _(n) and resource distribution (allocation ofresources such as CPU and memory capacities) to the virtual machines 430₁ to 430 _(m) via the hypervisors 421 ₁ to 421 _(n), thereby acquiringthe operating information of the virtual machines 430 ₁ to 430 _(m) andthe physical servers 420 ₁ to 420 _(n) (for example, CPU utilization,memory capacity, disk transfer rate, network transfer rate and the likeof the physical server, and CPU utilization, memory utilization, disktransfer rate, network transfer rate and the like of the virtualmachine). Based on this operating information, the operations manager461 estimates applications or the workloads 432 ₁ to 432 _(m) andderives a relation of the electric power of the physical servers 420 ₁to 420 _(n) with respect to the workload. For example, in the case wherea plurality of the virtual machines exist to a single physical server,if the overhead of the virtualization itself is small, it can beconsidered that the sum of the operation ratios or operation amounts ofthe plurality of the virtual machines is the operation ratio oroperation amount of the physical server. For example, assuming the casewhere CPU of eight cores in total exists in the physical servers, twocores are distributed in the virtual machine A and six cores aredistributed in the virtual machine B, the sum of the one-fourth of theCPU utilization of the virtual machine A and the three-fourths of theCPU utilization of the virtual machine B corresponds to the CPUutilization of the physical server, and the device power function can beexpressed as shown in expressions 10, 12 and 13.

The facility manager 463 acquires the locations and environmentalinformation of the facilities 440 ₁ to 440 _(u) and 450 ₁ to 450 _(v) toderive a relation of the facility power with respect to the powerdistribution of the physical servers 420 ₁ to 420 _(n). The operationsmanager 461 derives an optimum solution of the workload allocation tothe physical servers based on the relation of the physical server powerwith respect to the workload and the relation of the facility power withrespect to the power distribution of the physical servers. In accordancewith this solution, the virtualization manager 462 allocates the virtualmachines 430 ₁ to 430 _(m) equipped with the applications 432 ₁ to 432_(m) to the physical servers 420 ₁ to 420 _(n). FIG. 8 shows an examplewhere the application 432 ₂ is moved from the physical server 420 ₂ to420 ₁ together with the virtual machine 430 ₂ as shown with arrow 433.

According to the sixth embodiment, by using the live migration functionof the virtualization environment, the applications 432 ₁ to 432 _(m)can be moved between the physical servers 420 ₁ to 420 _(n) withoutstopping the operation thereof. Consequently, the workload allocationfor minimizing the total power of the servers and facilities can beexecuted simply, and the overhead and time loss accompanied by themovement of the workload can be suppressed, so that energy saving of theinformation-processing system can be realized. The sixth embodiment isan example of server units, but energy saving operation can be achievedsimilarly in the virtualization environment of storage units and networkunits. Note that, although the sixth embodiment employs a method inwhich the operations manager 461, the virtualization manager 462 and thefacility manager 463 cooperate with one another, any one of them may beincorporated in the other in accordance with the interface or thesoftware size.

Seventh Embodiment

FIG. 9 is a configuration diagram showing the operations managementdevice and operations management method of the information-processingsystem according to the seventh embodiment of the present invention. Theinformation-processing system 510 includes servers 520 ₁ to 520 _(n),storages 570 ₁ to 570 _(r), power supply facilities 540 ₁ to 540 _(u)and cooling facilities 550 ₁ to 550 _(v) for supplying power to theservers and storages and cooling the same, and an operations managementdevice 560 for managing these devices and facilities, and storage areanetwork (SAN) environment is formed. In the servers 520 ₁ to 520 _(n),applications 530 ₁ to 530 _(m) as the workloads are operated on OS 521 ₁to 521 _(n). In the operations management device 560, a SAN manager 562for managing the SAN constituted of the servers 520 ₁ to 520 _(n) andthe storages 570 ₁ to 570 _(r), a facility manager 563 for managing thefacilities 540 ₁ to 540 _(u) and 550 ₁ to 550 _(v) and an operationsmanager 561 for reducing the total power consumption of the servers 520₁ to 520 _(n), storages 570 ₁ to 570 _(r) and facilities 540 ₁ to 540_(u) and 550 ₁ to 550 _(v) are operated in coordination.

In the seventh embodiment, the SAN manager 562 monitors and manages theoperations of the severs 520 ₁ to 520 _(n), and the operations manager561 evaluates power of the severs 520 ₁ to 520 _(n) with respect to theapplications or the workloads 530 ₁ to 530 _(m). The facility manager563 obtains a facility power with respect to the power distribution ofthe servers 520 ₁ to 520 _(n) based on the locations and environmentalinformation of the facilities 540 ₁ to 540 _(u) and 550 ₁ to 550 _(v).The operations manager 561 obtains a workload allocation to minimize thetotal power of the servers and facilities based on the relation betweenthe server power distribution and the facility power. In accordance withthis solution, the SAN manager 562 temporarily interrupts the currentapplications 530 ₁ to 530 _(m) and withdraws to the storages 570 ₁ to570 _(r), and then starts up the servers 520 ₁ to 520 _(n) havingallocations by SAN boot so as to continue the applications 530 ₁ to 530_(m). Of the servers 520 ₁ to 520 _(n), servers having no allocation arestopped and powered off. Note that, in the execution of the workloadallocation, timings of activation/interruption/stop of the applications530 ₁ to 530 _(m) have to be sufficiently considered.

According to the seventh embodiment, by using the SAN boot function,energy saving operation for minimizing the total power of the serversand facilities can be carried out. There is an advantage that thisembodiment can be introduced easily to an existing system or the casewhere the virtualization environment is not prepared completely like thesixth embodiment. Also, the further energy saving can be achieved byemploying this embodiment together with the storages 570 ₁ to 570 _(r)in addition to the servers and facilities.

Eight Embodiment

FIG. 10 is a configuration diagram showing the operations managementdevice and operations management method of the information-processingsystem according to the eighth embodiment of the present invention. Theinformation-processing system 610 includes servers 620 ₁ to 620 _(n),storages 670 ₁ to 670 _(r), networks 680 ₁ to 680 _(s), power supplyfacilities 640 ₁ to 640 _(u) and cooling facilities 650 ₁ to 650 _(v)for supplying power to the servers, storages and networks and coolingthe same, and an operations management device 660 for integrallymanaging the devices and facilities, and an integral managementenvironment is formed. In the servers 620 ₁ to 620 _(n), applications630 ₁ to 630 _(m) and integral management agents 622 ₁ to 622 n as theworkloads are operated on OS 621 ₁ to 621 _(n). In the operationsmanagement device 660, a manager 662 for integrally managing the servers620 ₁ to 620 _(n), the storages 670 ₁ to 670 _(r) and the networks 680 ₁to 680 _(s), a facility manager 663 for managing the facilities 640 ₁ to640 _(u) and 650 ₁ to 650 _(v) and a power manager 661 for reducing thetotal power consumption of the devices 620 ₁ to 620 _(n), 670 ₁ to 670_(r) and 680 ₁ to 680 _(s) and the facilities 640 ₁ to 640 _(u) and 650₁ to 650 _(v) are operated in coordination.

In the eighth embodiment, the integrated manager 662 carries outoperations management and business operation of the servers 620 ₁ to 620_(n) via the agents 622 ₁ to 622 n, the power manager 661 estimatespower of the servers 620 ₁ to 620 _(n) for the applications 630 ₁ to 630_(m), and the facility manager 663 estimates power of the facilities 640₁ to 640 _(u) and 650 ₁ to 650 _(v). The power manager 661 obtains aworkload allocation in cooperation with the facility manager 663, andthe integrated manager 662 starts and stops the servers 620 ₁ to 620_(n) based thereon so as to change over a server which operates theapplications 630 ₁ to 630 _(m). In job scheduling, the workloads can beallocated by the arrangement for inputting jobs (applications) 630 ₁ to630 _(m) to the servers 620 ₁ to 620 _(n).

The operations management of the storages 670 ₁ to 670 _(r) and thenetworks 680 ₁ to 680 ₃ can be performed in the same manner as that ofthe servers 620 ₁ to 620 _(n). FIG. 11 is an explanatory diagram showingan example of the storages, and FIG. 12 is an explanatory diagramshowing an example of the networks. In FIG. 11, the storage units 671 ₁and 671 ₂ are constituted of disk arrays 672 and store data 673 ₁ to 673₃. By moving or copying data 673 ₂ having a high access frequency whichis a workload from the storage unit 671 ₂ to 671 ₁ as indicated witharrow 674, a desired workload allocation can be carried out. In FIG. 12,server units 623 ₁ to 623 ₄ are connected to network units 681 ₁ to 681₃, and the workload is moved by changing a connection to the server unit623 ₃ from the network unit 681 ₃ to 681 ₂ as indicated with arrow 682.After the workload allocation is changed, the storage units 671 ₁ and671 ₂ and the network units 681 ₁ to 681 ₃ control the power supply byactivating their energy saving functions. Note that, in the movement ofthe workload, it is important to sufficiently consider a processingtime, overhead of power and a risk accompanied by the processing in boththe storages and networks.

According to the eight embodiment, the servers, storages and networkunits can be managed integrally by the operations management and jogscheduling, and the total power consumption of all the devices andfacilities can be minimized. By combining such functions as the policyoperation, resource management, failure monitoring, power management andintegrated console possessed by the integrated manager 662 with theenergy saving function of the power manager 661, a more advanced andflexible system operation can be achieved. Note that the power manager661 and the facility manager 663 can be installed as a part or asubsystem of the integrated manager 662.

The major effects achieved by the operations management device and theoperations management method of the information-processing systemaccording to the embodiments described above are as follows.

By the means of the above-described embodiments, the total powerconsumption of the devices and facilities can be reduced by theoperations management in which the information-processing devices andthe facilities are operated in coordination. Thus, energy savingoperation of the information-processing system like a data center can beachieved, and the operating cost can be reduced and excessive investmentto facilities can be suppressed. Accordingly, it is possible tocontribute to the prevention of global warming and reduction of carbondioxide.

The means of the above-described respective embodiments pays attentionto electric power of the devices and facilities. However, by introducingthe hourly average and time integration regarding the workload of thedevices, operating information and environmental information of thefacilities, optimization of the workload in consideration of theprocessing time can be achieved easily, and the electric energy(electric power×time=energy) of the devices and facilities can bereduced. Further, in the allocation of the workloads to the devices, bytaking into consideration the processing priority order of theworkloads, the execution timing in a plan or an event and the electriccost in accordance with electric transmission system and charging systemas well as the electric power and electric energy, the respectiveembodiments can be applied as a policy operation with improved benefitand convenience.

The present embodiments are preferable for an autonomous energy savingoperations management method of the information-processing systemitself. Further, the solutions of workload allocation and themeasurement results of individual electric power and total electricpower of the devices and facilities obtained by the embodiments providea useful operations management policy also in energy saving diagnosisand improvement in an existing system, planning and adjustment in designand construction of a new system and expansion, moving, repair andupdating of the devices and facilities, risk management and costcalculation for a future information processing foresight, and operationmanagement and scenario establishment by manpower.

In the foregoing, the invention made by the inventors of the presentinvention has been concretely described based on the embodiments.However, it is needless to say that the present invention is not limitedto the foregoing embodiments and various modifications and alterationscan be made within the scope of the present invention.

The present embodiments can be applied to integrated energy savingoperations management in the information-processing system constitutedof the information-processing devices including the servers, storagesand networks, the power supply facilities and the cooling facilities,and are preferable particularly to the data center which bears aninformation-processing foundation. Further, the present embodiments arenot only used for autonomous operations management of theinformation-processing system but also used for wide variety ofapplications as a system establishing tool, energy saving diagnostictool, operation monitoring tool and auxiliary tool for an operationmanager and facility manager.

Further, the present embodiments can be applied to plural places as wellas the devices and facilities arranged at a place. For example, thepresent embodiments are useful also for a data center arranged acrossmultiple floors or data centers separated globally, and can be used forthe case where the information-processing devices and facilities aredispersed like in the grid computing and cloud computing. Further,although the present embodiments are mainly directed to theinformation-processing devices and facilities, the present embodimentscan be applied to devices which consume electric power or energy andrelated facilities thereof. For example, the present embodiments exertbeneficial effects on the operation and control of electric devices,mechanical devices, driving devices, thermal devices and the like, andcan contribute to the power saving and energy saving in any systemscales such as the electronic components and power supply or coolingdevice, the information-processing modules and power supply unit orcooling unit, and the data centers and power plant or coolingenvironment including a site location.

What is claimed is:
 1. An operations management method in aninformation-processing system including an operations management devicehaving a processor and a memory device, a plurality ofinformation-processing devices, and a plurality of facilities forsupplying power to and/or for cooling of the information-processingdevices, the method comprising the steps of: acquiring, by theoperations management device, locations of the information-processingdevices, locations of the facilities, and environmental information ofthe facilities; obtaining, by the operations management device, aplurality of combinations of allocations of workloads to be executed bythe information-processing devices based on the locations of theinformation-processing devices; calculating, by the operationsmanagement device, power consumptions of the respectiveinformation-processing devices with regard to each of the plurality ofcombinations of allocations of workloads to be executed by theinformation-processing devices based on a function or a numerical tableof the power consumptions of the respective information-processingdevices with regard to amounts of workloads to be executed by therespective information-processing devices; calculating, by theoperations management device, power consumptions of the facilitiesnecessary for each of the combinations based on the power consumptionsof the respective information-processing devices, the locations of theinformation-processing devices, the locations of the facilities, and theenvironmental information of the facilities; selecting, by theoperations management device, one of the combinations of allocations ofworkloads based on a solution of a combinational optimization problem,which minimizes the power consumption of the information-processingsystem, including the calculated power consumptions of the respectiveinformation-processing devices, calculated in the step of calculatingpower consumptions of the respective information-processing devices, andthe calculated power consumption of the facilities, calculated in thestep of calculating power consumption of the facilities; and allocating,by the operations management device, the workloads to theinformation-processing devices according to the one selected combinationof allocations of workloads, wherein the solution of minimizing powerconsumption is calculated by an approximate solution method algorithm.2. The operations management method in the information-processing systemaccording to claim 1, wherein the facilities carry out the cooling ofthe information-processing devices by heat exchange in a case where theinformation-processing system includes the facilities for cooling. 3.The operations management method in the information-processing systemaccording to claim 1, wherein the facilities include a plurality of airconditioners in a case where the information-processing system includesthe facilities for cooling.
 4. An operations management method in aninformation-processing system including an operations management devicehaving a processor and a memory device, a plurality ofinformation-processing devices, and a plurality of facilities forsupplying power to and/or for cooling of the information-processingdevices, the method comprising the steps of: acquiring, by theoperations management device, locations of the information-processingdevices, locations of the facilities and environmental information ofthe facilities; obtaining, by the operations management device, aplurality of combinations of allocations of workloads to be executed bythe information processing devices based on the locations of theinformation processing devices; calculating, by the operationsmanagement device, power consumptions of the respectiveinformation-processing devices with regard to each of the plurality ofcombinations of allocations of workloads to be executed by theinformation-processing devices based on a function or a numerical tableof the power consumptions of the respective information-processingdevices with regard to amounts of workloads to be executed by therespective information-processing devices; calculating, by theoperations management device, power consumptions of the facilitiesnecessary for each of the combinations based on the power consumptionsof the respective information-processing devices, the locations of theinformation-processing devices, the locations of the facilities and theenvironmental information of the facilities; selecting, by theoperations management device, one of the combinations of allocations ofworkloads that minimizes the power consumption of theinformation-processing system by comparing power consumptions of theinformation-processing system including the calculated powerconsumptions of the respective information-processing devices calculatedin the step of calculating power consumptions of the respectiveinformation-processing devices, and the calculated power consumption ofthe facilities among the combinations calculated in the step ofcalculating power consumption of the facilities; and allocating theworkloads to the information-processing devices according to the oneselected combination of allocations of workloads, wherein the comparingof power consumptions is accomplished by an approximate solution methodalgorithm to which a local search method is applied.
 5. The operationsmanagement method in the information-processing system according toclaim 4, wherein the facilities carry out the cooling of theinformation-processing devices by heat exchange in a case where theinformation-processing system includes the facilities for cooling. 6.The operations management method in the information-processing systemaccording to claim 4, wherein the facilities include a plurality of airconditioners in a case where the information-processing system includesthe facilities for cooling.
 7. A computer program, stored in anon-transitory computer readable medium of an operations managementdevice, for managing operations in an information-processing systemincluding the operations management device having the non-transitorycomputer readable medium, a plurality of information-processing devices,and a plurality of facilities for supplying power to and/or for coolingof the information-processing devices, the program, when executed by aprocessor of the operations management device causes the processor toexecute the program, the program comprising the steps of: acquiringlocations of the information-processing devices, locations of thefacilities and environmental information of the facilities; obtaining aplurality of combinations of allocations of workloads to be executed bythe information processing devices based on the locations of theinformation processing devices; calculating power consumptions of therespective information-processing devices with regard to each of theplurality of combinations of allocations of workloads to be executed bythe information-processing devices based on a function or a numericaltable of the power consumptions of the respective information-processingdevices with regard to amounts of workloads to be executed by therespective information-processing devices; calculating powerconsumptions of the facilities necessary for each of the combinationsbased on the power consumptions of the respective information-processingdevices, the locations of the information-processing devices, thelocations of the facilities and the environmental information of thefacilities; selecting one of the combinations of allocations ofworkloads based on a solution of a combinational optimization problem,which minimizes the power consumption of the information-processingsystem including the calculated power consumptions of the respectiveinformation-processing devices calculated in the step of calculatingpower consumptions of the respective information-processing devices, andthe calculated power consumption of the facilities calculated in thestep of calculating power consumption of the facilities; and allocatingthe workloads to the information-processing devices according to the oneselected combination of allocations of workloads, wherein the solutionof minimizing power consumption is calculated by an approximate solutionmethod algorithm.
 8. The computer program for managing operations in theinformation-processing system according to claim 7, wherein theinformation-processing system includes the facilities for cooling, andthe facilities carry out the cooling of the information-processingdevices by heat exchange.
 9. The computer program for managingoperations in the information-processing system according to claim 7,wherein the information-processing system includes the facilities forcooling, and the facilities include a plurality of air conditioners. 10.A computer program, stored on a non-transitory computer readable mediumof an operations management device, for managing operations in aninformation-processing system including the operations managementdevice, a plurality of information-processing devices, and a pluralityof facilities for supplying power to and/or for cooling of theinformation-processing devices, the program when executed by a processorof the operations management device causes the processor to execute theprogram, the program comprising the steps of: acquiring locations of theinformation-processing devices, locations of the facilities andenvironmental information of the facilities; obtaining a plurality ofcombinations of allocations of workloads to be executed by theinformation processing devices based on the locations of the informationprocessing devices; calculating power consumptions of the respectiveinformation-processing devices with regard to each of the plurality ofcombinations of allocations of workloads to be executed by theinformation-processing devices based on a function or a numerical tableof the power consumptions of the respective information-processingdevices with regard to amounts of workloads to be executed by therespective information-processing devices; calculating powerconsumptions of the facilities necessary for each of the combinationsbased on the power consumptions of the respective information-processingdevices, the locations of the information-processing devices, thelocations of the facilities and the environmental information of thefacilities; selecting one of the combinations of allocations ofworkloads that minimizes the power consumption of theinformation-processing system by comparing power consumptions of theinformation-processing system including the calculated powerconsumptions of the respective information-processing devices calculatedin the step of calculating power consumptions of the respectiveinformation-processing devices, and the calculated power consumption ofthe facilities among the combinations calculated in the step ofcalculating power consumption of the facilities; and allocating, by theoperations management device the workloads to the information-processingdevices according to the one selected combination of allocations ofworkloads, wherein the comparing of power consumptions is accomplishedby an approximate solution method algorithm to which a local searchmethod is applied.
 11. The computer program for managing operations inthe information-processing system according to claim 10, wherein theinformation-processing system includes the facilities for cooling, andthe facilities carry out the cooling of the information-processingdevices by heat exchange.
 12. The computer program for managingoperations in the information-processing system according to claim 10,wherein the information-processing system includes the facilities forcooling, and the facilities include a plurality of air conditioners. 13.A device for managing operations in an information-processing systemincluding a plurality of information-processing devices, and a pluralityof facilities for supplying power to and/or for cooling of theinformation-processing devices, the device comprising: one or moreprocessors and one or more memory devices; an information acquisitionunit stored on the one or more memory devices and executable by the oneor more processors; a workload allocation unit stored on the one or morememory devices and executable by the one or more processors; aninformation-processing device power consumption calculating unit storedon the one or more memory devices and executable by the one or moreprocessors; and a facilities power consumption calculating unit storedon the one or more memory devices and executable by the one or moreprocessors, wherein the information acquisition unit is configured toacquire locations of the information-processing devices, locations ofthe facilities, and environmental information of the facilities, whereinthe workload allocation unit is configured to obtain a plurality ofcombinations of allocations of workloads to be executed by informationprocessing devices based on the locations of the information processingdevices, wherein the information-processing device power consumptioncalculating unit is configured to calculate power consumptions of therespective information-processing devices with regard to each of theplurality of combinations of allocations of workloads to be executed bythe information-processing devices based on a function or a numericaltable of the power consumptions of the respective information-processingdevices with regard to amounts of workloads to be executed by therespective information-processing devices, wherein the facilities powerconsumption calculating unit is configured to calculate powerconsumptions of the facilities necessary for each of the combinationsbased on the power consumptions of the respective information-processingdevices, the locations of the information-processing devices, thelocations of the facilities and the environmental information of thefacilities, wherein the workload allocation unit is configured to selectone of the combinations of allocations of workloads based on a solutionof a combinational optimization problem, which minimizes the powerconsumption of the information-processing system including thecalculated power consumptions of the respective information-processingdevices calculated by the information-processing device powerconsumption calculating unit, and the power consumption of thefacilities calculated by the facilities power consumption calculatingunit, wherein the workload allocation unit is configured to allocate theworkloads to the information-processing devices according to the oneselected combination of allocations of workloads, and wherein thesolution of minimizing power consumption is calculated by an approximatesolution method algorithm.
 14. The device for managing operations in theinformation-processing system according to claim 13, wherein theinformation-processing system includes the facilities for cooling, andthe facilities carry out the cooling of the information-processingdevices by heat exchange.
 15. The device for managing operations in theinformation-processing system according to claim 13, wherein theinformation-processing system includes the facilities for cooling, andthe facilities include a plurality of air conditioners.
 16. A device formanaging operations in an information-processing system including aplurality of information-processing devices, and a plurality offacilities for supplying power to and/or for cooling of theinformation-processing devices, the device comprising: one or moreprocessors and one or more memory devices; an information acquisitionunit stored on the one or more memory devices and executable by the oneor more processors; a workload allocation unit stored on the one or morememory devices and executable by the one or more processors; aninformation-processing device power consumption calculating unit storedon the one or more memory devices and executable by the one or moreprocessors; and a facilities power consumption calculating unit storedon the one or more memory devices and executable by the one or moreprocessors, wherein the information acquisition unit Is configured toacquire locations of the information-processing devices, locations ofthe facilities, and environmental information of the facilities, whereinthe workload allocation unit is configured to obtain a plurality ofcombinations of allocations of workloads to be executed by informationprocessing devices based on the locations of the information processingdevices, wherein the information-processing device power consumptioncalculating unit is configured to calculate power consumptions of therespective information-processing devices with regard to each of theplurality of combinations of allocations of workloads to be executed bythe information-processing devices based on a function or a numericaltable of the power consumptions of the respective information-processingdevices with regard to amounts of workloads to be executed by therespective information-processing devices, wherein the facilities powerconsumption calculating unit is configured to calculate a powerconsumptions of the facilities necessary for each of the combinationsbased on the power consumptions of the respective information-processingdevices, the locations of the information-processing devices, thelocations of the facilities and the environmental information of thefacilities, wherein the workload allocation unit is configured to selectone of the combinations of allocations of workloads that minimizes thepower consumption of the information-processing system by comparingpower consumptions of the information-processing system including thecalculated power consumptions of the respective information-processingdevices calculated by the information-processing device powerconsumption calculating unit, and the power consumption of thefacilities among the combinations calculated by the facilities powerconsumption calculating unit, wherein the workload allocation unit isconfigured to allocate the workloads to the information-processingdevices according to the one selected combination of allocations ofworkloads, and wherein the comparing of power consumptions isaccomplished by an approximate solution method algorithm to which alocal search method is applied.
 17. The device for managing operationsin the information-processing system according to claim 16, wherein theinformation-processing system includes the facilities for cooling, andthe facilities carry out the cooling of the information-processingdevices by heat exchange.
 18. The device for managing operations in theinformation-processing system according to claim 16, wherein theinformation-processing system includes the facilities for cooling, andthe facilities include a plurality of air conditioners.
 19. Aninformation-processing system comprising: a plurality ofinformation-processing devices; a plurality of facilities for supplyingpower to and/or for cooling the information-processing devices; and anoperation management device comprising: one or more processors and oneor more memory devices; an information acquisition unit stored on theone or more memory devices and executable by the one or more processors;a workload allocation unit stored on the one or more memory devices andexecutable by the one or more processors; an information-processingdevice power consumption calculating unit stored on the one or morememory devices and executable by the one or more processors; and afacilities power consumption calculating unit stored on the one or morememory devices and executable by the one or more processors, wherein theinformation acquisition unit is configured to acquire locations of theinformation-processing devices, locations of the facilities andenvironmental information of the facilities, wherein the workloadallocation unit is configured to obtain a plurality of combinations ofallocations of workloads to be executed by information processingdevices based on the locations of the information processing devices,wherein the information-processing device power consumption calculatingunit is configured to calculate power consumptions of the respectiveinformation-processing devices with regard to each of the plurality ofcombinations of allocations of workloads to be executed by theinformation-processing devices based on a function or a numerical tableof the power consumptions of the respective information-processingdevices with regard to amounts of workloads to be executed by therespective information-processing devices, wherein the facilities powerconsumption calculating unit is configured to calculate powerconsumptions of the facilities necessary for each of the combinationsbased on the power consumptions of the respective information-processingdevices, the locations of the information-processing devices, thelocations of the facilities and the environmental information of thefacilities, wherein the workload allocation unit is configured to selectone of the combinations of allocations of workloads based on a solutionof a combinational optimization problem, which minimizes the powerconsumption of the information-processing system including thecalculated power consumptions of the respective information-processingdevices calculated by the information-processing device powerconsumption calculating unit, and the power consumption of thefacilities calculated by the facilities power consumption calculatingunit, wherein the workload allocation unit is configured to allocate theworkloads to the information-processing devices according to the oneselected combination of allocations of workloads, and wherein thesolution of minimizing power consumption is calculated by an approximatesolution method algorithm.
 20. The information-processing systemaccording to claim 19, wherein the information-processing systemincludes the facilities for cooling, and the facilities carry out thecooling of the information-processing devices by heat exchange.
 21. Theinformation-processing system according to claim 19, wherein theinformation-processing system includes the facilities for cooling, andthe facilities include a plurality of air conditioners.
 22. Aninformation-processing system comprising: a plurality ofinformation-processing devices; a plurality of facilities for supplyingpower to and/or for cooling of the information-processing devices; andan operation management device comprising: one or more processors andone or more memory devices connected to the one or more processors; aninformation acquisition unit stored on the one or more memory devicesand executable by the one or more processors; a workload allocation unitstored on the one or more memory devices and executable by the one ormore processors; an information-processing device power consumptioncalculating unit stored on the one or more memory devices and executableby the one or more processors; and a facilities power consumptioncalculating unit stored on the one or more memory devices and executableby the one or more processors, wherein the information acquisition unitis configured to acquire locations of the information-processingdevices, locations of the facilities and environmental information ofthe facilities, wherein the workload allocation unit is configured toobtain a plurality of combinations of allocations of workloads to beexecuted by information processing devices based on the locations of theinformation processing devices; wherein the information-processingdevice power consumption calculating unit is configured to calculatepower consumptions of the respective information-processing devices withregard to each of the of combinations of allocations of workloads to beexecuted by the information-processing devices based on a function or anumerical table of the power consumptions of the respectiveinformation-processing devices with regard to amounts of workloads to beexecuted by the respective information-processing devices, wherein thefacilities power consumption calculating unit is configured to calculatepower consumptions of the facilities necessary for each of thecombinations based on the power consumptions of the respectiveinformation-processing devices, the locations of theinformation-processing devices, the locations of the facilities and theenvironmental information of the facilities, wherein the workloadallocation unit is configured to select one of the combinations ofallocations of workloads that minimizes the power consumption of theinformation-processing system by comparing power consumptions of theinformation-processing system including the calculated powerconsumptions of the respective information-processing devices calculatedby the information-processing device power consumption calculating unit,and the power consumption of the facilities among the combinationscalculated by the facilities power consumption calculating unit, whereinthe workload allocation unit is configured to allocate the workloads tothe information-processing devices according to the one selectedcombination of allocations of workloads, and wherein the comparing ofpower consumptions is accomplished by an approximate solution methodalgorithm to which a local search method is applied.
 23. Theinformation-processing system according to claim 22, wherein theinformation-processing system includes the facilities for cooling, andthe facilities carry out the cooling of the information-processingdevices by heat exchange.
 24. The information-processing systemaccording to claim 22, wherein the information-processing systemincludes the facilities for cooling, and the facilities include aplurality of air conditioners.